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DETAILED ACTION 
Response to Arguments 

1 . Applicant's arguments filed 4/27/06 have been fully considered but they are not persuasive as 
to claims 1-20. 

For claims 1, 6, 1 1, 16, the applicant argues that the combination of Acharya (U.S. Patent 
6,108,453) and Kamei (U.S. Patent 5, 528,698) cannot obvious Applicant's claims 1, 6, 1 1 
and 16, because applicant believes Kamei's image mapping functions use histogram 
equalization to determine edge information, thus, Kamei cannot be properly interpreted as 
teaching or suggesting providing edge enhancements using a brightness map as claimed (See 
Applicant's REMARKS page 6, lines 23-27). 

The examiner disagrees. The Kamei reference clearly discloses the raw sensed image is 
input into a preprocessor v^hich applies certain intensity (brightness) mapping functions to 
provide enhanced details, edges (See Col. 6, lines 14-27). Therefor, the Kamei reference 
teaches providing edge enhancements using a brightness map as claimed in claims 1, 6, 1 1, 
16. 

Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness 

rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinaiy skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 



Application/Control Number: 09/696,436 Page 3 

Art Unit: 2622 

3. Claims I-I65 18 and 19 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Acharya et al. U.S. Patent 6,108,453 in view of Kamei et al. U.S. Patent 5,528,698. 

Referring to claim 1, the Acharya reference discloses in Figiires 1, 5 and 7, an image 
processing method comprising: capturing a raw image (camera 730 obtains a raw images, see 
C0I.4, lines 65-67); and providing edge enhancements to increase edge detail of the captured 
raw image as part of a demosaicing process (e.g., performing image edge enhancements on 
the captured raw image prior to forming full color pixels through color interpolation as part 
of a demosaicing process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, lines 1-7; the 
Enhanced image 510 as shown in Figure 5 with better detail, such as sharper edges and less 
noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13). However, the Acharya reference does 
not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished. 
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and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 2, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 1, and the Acharya reference discloses performing post 
demosaicing processing on the captured raw image (e.g., the color interpolation processing, 
noise removal or other image enhancement processing are considered as post demosaicing 
processing in the image processing circuit 732, see Col. 9-35); and outputting the processed 
image to display devices (720). 

Referring to claim 3, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 1, the Kamei reference discloses wherein providing the edge 
enhancements includes: creating a brightness map of the captured raw image (e.g., the image 
processing method of Kamei creating 256 gray scale image or a histogram of intensity of 
image; and the Acharya reference also discloses the pre-enhancement map 330 of the 
captured raw image contains the pixel intensity values considered as a brightness map, see 
Col. 4, lines 1-4). 

Referring to claim 4, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 3, and the Acharya reference discloses wherein providing the 
edge enhancements further includes: detecting edges of the captured raw image using the 
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brightness map (e.g., See Kamei's Col. 6, lines 14-19); creating a mask image (approximated 
image 320) form the edge detected brightness map (See Col. 3, lines 60-67); and performing 
unsharp edge enhancement from the masked image (e.g., due to the effectiveness of the 
smoothing performed as unsharp edge enhancement, the approximated image is slightly 
blurred, the edge definition will not be as great as the raw imager 310). 

Referring to claim 5, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 4, and the Acharya reference discloses wherein providing the 
edge enhancements further includes: blending multiplicatively the unsharp edge enhanced 
image (approximated image 320) with the brightness map (410) as shown in Figure 5. 

Referring to claim 6, the Acharya reference discloses in Figures 1, 5 and 1, an apparatus 
comprising: an image capturing device capturing a raw image (camera 730 obtains a raw 
images, see Col.4, lines 65-67); and a processor (processor 712, see Col. 5, lines 55-62) to 
provide edge enhancements to increase edge detail of the captured raw image as part of a 
demosaicing process (e.g., performing image edge enhancements on the captured raw image 
prior to forming full color pixels through color interpolation as part of a demosaicing 
process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, lines 1-7; the Enhanced image 510 as 
shown in Figure 5 with better detail, such as sharper edges and less noise, see Col. 4, lines 
20-25, and Col. 6, lines 12-13). However, the Acharya reference does not explicitly show 
using a brightness map of the captured raw image for edge enhancements, wherein the 
brightness map comprises luminance values extracted from the captured raw image. 

The Kamei reference teaches in Figxires 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
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enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya C453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 7, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 2 and 6. 

Referring to claim 8, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 3 and 6. 

Referring to claim 9, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 4 and 8. 

Referring to claim 10, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 5 and 9. 
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Referring to claim 1 1, the Acharya reference discloses in Figxires 1, 5 and 7, a machine- 
readable medium (RAM 71 1, see Col. 5, lines 20-30) that provides instructions, which if 
executed by a processor (processor 712, see Col. 5, lines 55-62), cause the processor to 
perform the operations comprising: capturing a raw image (camera 730 obtains a raw images, 
see Col.4, lines 65-67); and providing edge enhancements to increase edge detail of the 
captured raw image as part of a demosaicing process (e.g., performing image edge 
enhancements on the captured raw image prior to forming full color pixels through color 
interpolation as part of a demosaicing process, see Col. 5, lines 5-16, lines 64-67 and Col. 6, 
lines 1-7; the Enhanced image 510 as shown in Figure 5 with better detail, such as sharper 
edges and less noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13). However, the Acharya 
reference does not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See Col. 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity, See Col. 5, lines 28-30 
and Col. 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
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and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya C453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
comprises luminance values extracted from the captured raw image as taught by Kamei 
C698). 

Referring to claim 12, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as v^th claims 2 and 1 1 . 

Referring to claim 13, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 3 and 1 1 . 

Referring to claim 14, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 4 and 1 1 . 

Referring to claim 15, the Acharya and Kamei references disclose all subject matter as 
discussed with respected to same comment as with claims 5 and 1 1 . 

Referring to claim 16, the Acharya reference discloses in Figures 1, 5 and 7, an image 
processing device comprising: an image capturing device capturing a raw image (camera 730 
obtains a raw images, see CoL4, lines 65-67); a memory device (disk 718, or memory 711, 
see Col. 5, lines 10-11, lines 55-57 and lines 63-64) to store the captured raw image; an 
output unit (display device 720 and adapter 716) coupled to the memory device as shown in 
Figure 7; and a processor (processor 712, see Col. 5, lines 55-62) to provide edge 
enhancements to increase edge detail of the captured raw image as part of a demosaicing 
process and to cause the enhanced image to be output is to the output unit (e.g., performing 
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image edge enhancements on the captured raw image prior to forming full color pixels 
through color interpolation as part of a demosaicing process, see Col. 5, lines 5-16, lines 64- 
67 and Col. 6, lines 1-7; the Enhanced image 510 as shown in Figure 5 with better detail, 
such as sharper edges and less noise, see Col. 4, lines 20-25, and Col. 6, lines 12-13; and the 
enhanced image output to the display devices 720 and 716). However, the Acharya reference 
does not explicitly show using a brightness map of the captured raw image for edge 
enhancements, wherein the brightness map comprises luminance values extracted from the 
captured raw image. 

The Kamei reference teaches in Figures 3 and 6, an image processing method 
comprising: using a brightness map (intensity map) of the captured raw image for edge 
enhancements (See CoL 6, lines 14-19), wherein the brightness map comprises luminance 
values (gray scale values) extracted from the captured raw image (e.g., translates captured 
raw image into a gray scale image or a histogram of pixel intensity. See Col. 5, lines 28-30 
and CoL 9, lines 24-25). The Kamei reference is evidence that one of ordinary skill in the art 
at the time to see more advantages image processing method using a brightness map of the 
captured raw image for edge enhancements, wherein the brightness map comprises 
luminance values extracted from the captured raw image so that the edges are distinguished, 
and the angles of the edges are determined more accurately and easily (See Col. 5, lines 49- 
62). For that reason, it would have been obvious to one of ordinary skill in the art at the time 
of invention to modify the image processing method of Acharya ('453) by using a brightness 
map of the captured raw image for edge enhancements, wherein the brightness map 
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comprises luminance values extracted from the captured raw image as taught by Kamei 
(^698). 

Referring to claim 18, the Acharya and Kamei references disclose wherein the output imit 
is a display device (monitor 720) as shown in Figure 7. 

Referring to claim 19, the Acharya and Kamei references disclose wherein the processor 
(712) is to perform post demosaicing processing (the color interpolation processing) on the 
captured raw image and to cause the image to be output to the display (720) (See Col. 6, lines 
9-18). 

4. Claims 17 and 20 are rejected under 35 U.S.C. 103(a) as being unpatentable over Acharya et 
al. U.S. Patent 6,108,453 in view of Kamei et al. U.S. Patent 5,528,698 and Lathrop et al. 
U.S. Patent 6,288,743. 

Referring to claim 17, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 16, and the Acharya reference discloses the camera (730) is a 
digital camera for capturing a sensor image of an object or scene (See Col. 4, lines 58-60). 
However the Acharya reference does not explicitly states the camera includes a CCD array. 

The Lathrop reference discloses in Figure 1, a digital camera (10, See Col. 3, lines 5-32) 
comprising: a image sensor (CCD 16). The Lathrop reference is evidence that the digital 
camera using CCD as a image sensor to capture a image of an object or scene which is well 
known to one of ordinary skill in the art at the time the invention made so that captured 
image data can be easily digitized and stored in ma non- volatile image memory (See Col 1, 
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lines 10-15). For that reason, it would have been obvious to one of ordinary skill in the art to 
see the digital camera (730) including a CCD array sensor disclosed by Acharya. 

Referring to claim 20, the Acharya and Kamei references disclose all subject matter as 
discussed in respected claim 19, except the Acharya reference does not explicitly states the 
other image enhancement processing executed after color interpolation as the post 
demosaicing processing is a white balancing processing. 

The Lathrop reference discloses an imaging apparatus (digital camera 10) has a 
demosaicing processing (interpolate the Bayer pattem digital image data); and a post 
demosaicing processing (white balance, see Col. 3, lines 50-55) for a white balancing 
processing. The Lathrop reference is evidence that one of ordinary skill in the art at the time 
to see more advantages the post demosaicing processing is a white balancing or other image 
processing so that the scene illumination can be estimate more accurately. For that reason, it 
would have been obvious to one of ordinary skill in the art to see the post demosaicing 
processing is a white balancing processing disclosed by Acharya. 

Conclusion 

5. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time policy 
as set forth in 37 CFR 1. 136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed xmtil 
after the end of the THREE-MONTH shortened statutory period, then the shortened statutory 
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period will expire on the date the advisory action is mailed, and any extension fee pursuant to 
37 CFR 1 .136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the mailing 
date of this final action. 

6. Any inquiry concerning this communication or earlier communications from the examiner 
should be directed to Lin Ye whose telephone number is (571) 272-7372. The examiner can 
normally be reached on Mon-Fri 8:00AM-5:00PM. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David L. Ometz can be reached on (571) 272-7593. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published 
applications may be obtained from either Private PAIR or Public PAIR. Status information 
for unpublished applications is available through Private PAIR only. For more information 
about the PAIR system, see http://pair-direct.uspto.gov. Should you have questions on access 
to the Private PAIR system, contact the Electronic Business Center (EBC) at 866-217-9197 
(toll-free). If you would like assistance from a USPTO Customer Service Representative or 
access to the automated information system, call 800-786-9199 (IN USA OR CANADA) or 
571-272-1000. ^ 
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